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In this paper we present a first-principles analysis of the nonequilibrium work distribution and 
the free energy difference of a quantum system interacting with a general environment (with arbi- 
trary spectral density and for all temperatures) based on a well-understood micro-physics (quantum 
Brownian motion) model under the conditions stipulated by the Jarzynski equality [C. Jarzynski, 
Phys. Rev. Lett. 78, 2690 (1997)] and Crooks' fluctuation theorem [G. E. Crooks, Phys. Rev. E 60, 
2721 (1999)] (in short FTs). We use the decoherent history conceptual framework to explain how the 
notion of trajectories in a quantum system can be made viable and use the environment-induced 
decoherence scheme to assess the strength of noise which could provide sufficient decoherence to 
I warrant the use of trajectories to define work in open quantum systems. From the solutions to the 

Langevin equation governing the stochastic dynamics of such systems we were able to produce for- 
C ■ mal expressions for these quantities entering in the FTs, and from them prove explicitly the validity 

of the FTs at the high temperature limit. At low temperatures our general results would enable one 
to identify the range of parameters where FTs may not hold or need be expressed differently. We 
explain the relation between classical and quantum FTs and the advantage of this micro-physics 
open-system approach over the phenomenological modeling and energy-level calculations for substi- 
' (— I ' ] tute closed quantum systems. 
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qH , I. INTRODUCTION 

Unlike in equilibrium statistical physics, few theorems of generality are established for nonequilibrium systems. 
Hence any valid statement with a broad spectrum of implications and wide range of applications is of great value. 
The fluctuation theorems (FTs) of Jarzynski [i| and Crooks "'^ in nonequilibrium statistical mechanics are of 
' such a nature which have stimulated intense research interest and activities in the past decade. For earlier work on 
^ I entropy fluctuation theorems, such as by Cohen, Evans, Searles and others, see, e.g., [3]. FTs relate some equilibrium 
thermodynamic quantities of a physical system, like free energy differences, to the averages of mechanical quantities 
in nonequilibrium processes, like exponentiated work. For complex biological systems like proteins and DNAs the free 
. energy differences are difficult to calculate while the averages of work in nonequilibrium processes can be obtained 

' from measurements in experiments or via numerical simulations. 
ON 
O 

A. Background and Basic Issues 

. , — , , a. How to define work in quantum physics ? The fluctuation theorems were originally derived for classical ther- 
■ modynamic systems. It is natural to ask if they hold for quantum systems, and if not, under what conditions would 
J-j they fail, and whether there exist quantum fluctuation theorems (QFTs) different in form and content from the clas- 
. - - 1 sical FTs. If this is not possible, can one find an approximate form in terms of corrections to the classical FTs. To 
our knowledge corrections have been derived but a full QFT that is valid for all conditions (e.g., non-Ohmic spectral 
density of the environments at low temperature) is still at large. 

In these endeavors the main conceptual obstacle is how to make sense of work in a quantum setting. To begin 
with, work is not an observable Q , and as such, treating it as a quantum mechanical operator Q is largely a 
computational convenience. Thus the foremost task is to find a physically meaningful definition and an operationally 
feasible way to calculate it. We will address this issue with a new approach described below. 

Let us try to appreciate the content of this pivotal point. In classical mechanics exclusive work [7,] imparted to a 
system, say a particle, is defined as the integration of applied force on the system with displacement along a path. 
The force is exerted by an external agent which causes the system to move along a trajectory. Once one knows the 
trajectory, work can be calculated, but the difficulty for quantum system is that particles don't follow trajectories, 



^ By the FTs we refer specifically to Jarzynski's equality and Crooks's fluctuation theorem only. 
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they are described by a wave function which is a very different notion and entity from paths. The key challenge is to 
make sense of trajectories in quantum physics. We mention several approaches below and then present our own. 

b. Closed versus open quantum system If one restricts ones attention to closed quantum systems, i.e., isolated 
quantum systems having no interaction with any of their environments, one can define work via transitions between 
the systems energy levels (quantum jumps) JJ, and general agreement seems to be reached. However this is merely 
an idealization of realistic physical systems which are more often open. The influence of their environments which 
the system of interest interacts with need be accounted for in the open system's evolution. Even in the simplest 
cases when one talks about temperature or refers to (equilibrium) thermodynamic quantities a heat bath (canonical 
ensemble) or a particle reservoir (grand canonical ensemble) is implicitly assumed, which are open-system setups. 

Since for closed quantum systems fluctuation theorems can be easily derived, one can think of the system + 
environment as a closed system and work out the QFTs. This was done in P^Hl- However this formulation has the 
innate shortcoming that the work defined therein requires the change in energy of the combined system while the FTs 
refer to the work on the open system of interest (being a subsystem of the combined, whose dynamics includes the 
back-action from the other subsystems as its environment). 

c. Microscopic models for open system dynamics The use of a microphysics model such as the quantum Brownian 
motion (QBM) model described below could provide a rigorous basis for any phenomenological description. It makes 
explicit any assumption made in the phenomenological models which enables one to clearly define the range of validity 
of the results derived from each model, as well as being able to provide the details in the derivations with or without the 
corresponding assumptions. Applying methods of nonequilibrium statistical mechanics such as the Zwangzig-Mori- 
Nakajima projection operator or the Feynman- Vernon influence functional (IF) formalism to a microscopic model 
consummates the objectives of quantum open-system treatment. Using these methods one obtains a description of 
the open-system dynamics in terms of open system variables alone, while the dynamics of the open system already 
factored in the back-action of the environment. Environment related quantities like heat can also be addressed within 
this framework. The IF is the method we have used before and prefer, since it has the advantage of including the 
back-action in a self-consistent manner and one can invoke fleld theory techniques (by way of the almost equivalent 
Schwinger-Keldysh closed time path formalism) to address nonequilibrium statistical mechanics issues. 

Using microscopic models and open system dynamics several suggestions for trajectories have been made. For 
example, De Roeck [l^ used the unravelin g of the open system master equation and compared his results to that of 
the closed system approach. Deffner et al. 13] used the quantum Smoluchowski equation (QSE), which was derived 
from taking the high friction and high temperature limit in [14], as a starting point. They considered the solution to the 
QSE in terms of classical path integrals and interpreted these paths as trajectories. But these trajectories are difficult 
to interpret physically, being more in the nature as devices (to help solve a differential equation) than actual physical 
entities. By making the assumption that the reduced dynamics of a driven open quantum subsystem is described by 
a quantum master equation Esposito and Mukamel [T5| recast its solution in a representation which takes the form of 
a birth-death master equation (BDME) with time-dependent rates and used it to define "quantum" trajectories. But 
these QSE and BDME, just as the Pauli master equation, govern transition probabilities, are equivalent to a reduced 
density matrix with only diagonal elements, and thus contain no quantum phase information ^. 

Alternatively Crooks [16] proved the Jarzynski equality by considering the Markovian dynamics of a quantum 
system in the following setting: Instead of measuring the system, generalized measurement superoperators were used 
to represent measurements of heat flow. If the quantum environment is assumed to be large, to have rapidly decohered 
and always remain at thermal equilibrium, plus being uncorrelated and unentangled with the system, then the change 
in energy of the bath can be measured without further disturbing the dynamics of the system. 

In comparison with earlier work our approach is closest in spirit to that of Chernyak and Mukamel [sj. However 
our methods (they use superoperators in Liouville space) and interpretations (they use von Neumann's wave function 
collapse for quantum measurement) are different. We will detail the differences after we have a chance to describe 
our approach. 



^ This may be viewed as the completely decohered end product of a decoherent history or environment-induced decoherence process 
(complete diagonalization of the reduced density matrix) but as we shall explain in more detail below, it corresponds to the case of 
very strong noise acting on the subsystem, which is possible for high temperatures, and thus it falls under the parameter regime where 
the classical FTs are valid. In fact for Gaussian systems, the QFT derived under these conditions have exactly the same form as the 
classical FTs. 



3 



B. Our approach and findings 

For the sake of conciseness we just state what wc do and name the ingredients in our approach here, leaving more 
detailed explanations to the next section. 

In this paper we analyze the fluctuation theorems (FTs) using the exactly solvable microscopic quantum Brownian 
motion (QBM) model of a quantum harmonic oscillator coupled to a heat bath of N quantum harmonic oscillators 
with arbitrary spectral density function and for all temperatures. This is referred to as a 'general' environment in 
fll\ where an exact master equation for these full ranges was obtained and where our discussions in the application 
of this model to QFTs are based upon The low temperature results are of special interest for the derivation of the 
QFT since it measures the deviation from the classical FTs. 

d. Decoherent history approach to define trajectories for quantum systems We resort to the conceptual framework 
of decoherent [18] or consistent [H, H^l histories (dechis) and the key notion of decoherence for understanding the 
process of quantum to classical transition. We believe this is the most faithful and intuitive way of defining trajectories 
or explaining how they arise from quantum mechanics. To be more precise, these trajectories are actually stochastic 
classical paths in a quasi-classical domain as a result of decoherence in the histories. They arise by the action of noise 
which are defined as variations in neighboring histories. (For a succinct explanation of the first point see e.g., [Tgl. [2l| 
and [22:1] on the second point.) 

e. Environment-induced decoherence for explicit computations While the decoherent history paradigm is concep- 
tually clear for explaining the origin and mechanisms in the emergence of classical stochastic trajectories, it is less 
versatile in actual computations. The environment- induced decoherence (envdec) approach can be of more practical 
use. Here, the approximate diagonalization of the reduced density matrix of the reduced or open system with respect 
to some basis is used as a signifier of decoherence of the quantum system in transit to classicality, whereby the notion 
of trajectory becomes viable. But which basis? This is the physically relevant issue. The quantum system is more 
readily decohered in the so-called "pointer basis" [l^l which is affected by the form of interaction between the system 
and its environment. Here, with an explicit environment specified, it is easier to see how noise arises and its nature 
(colored, multi plic ative |24| ) than in the decoherent history approach. The connection between these two approaches 
is discussed in |25l | . An explicit model calculation (the QBM model) was given in the dechis approach [26| where one 
can compare these two approaches in operational details. 

/. Significance of stochastic regime between quantum and classical In reference to trajectories of quantum origin 
we notedly attach the word 'stochastic' to classical. This is because there is a stochastic component to them after 
the quantum histories decohere. They are described by a probability distribution function. Each such trajectory is a 
realization of this distribution. Taking the stochastic average of an ensemble of such trajectories will yield the unique 
classical path which is a solution of a deterministic classical equation of motion. 

Decoherence is due to noise, quantum or thermal or both. In the envdec scheme, one can see this explicitly from 
the stochastic equations governing the open (reduced) system. Noise is responsible for quantum diffusion which 
brings forth decoherence. The stronger the noise the more complete the decoherence process and the more classical 
the trajectories. In fact for the QBM model there are two diffusion terms: a normal diffusion dominates at high 
temperatures and an anomalous diffusion which dominates at low temperature. The latter is what one should focus 
on in marking the difference between the classical and the quantum FTs. Therefore the behavior of a system in the 
stochastic regime actually holds the key to quantum-classical transition or correspondence. It is particularly suitable 
for the exploration of FTs in open systems as they are also cast in a stochastic framework in terms of the probability 
distribution of work. 

g. Our findings In this paper we present a first-principles analysis of the nonequilibrium work distribution and 
the free energy difference of a quantum system interacting with a general environment (with arbitrary spectral density 
and for all temperatures) based on a well-understood micro-physics (quantum Brownian motion) model under the 
conditions stipulated by the Jarzynski equality and Crooks' fluctuation theorem (FTs). We use the decoherent history 
conceptual framework to explain how the notion of trajectories in a quantum system can be made viable and use the 
environment-induced decoherence scheme to assess the strength of noise which could provide sufficient decoherence to 
warrant the use of trajectories to deflne work in open quantum systems. From the solutions to the Langevin equation 
governing the stochastic dynamics of such systems we were able to produce formal expressions for these quantities 
entering in the FTs, and from them prove explicitly the validity of the FTs at the high temperature limit. At low 
temperatures our general results would enable one to identify the range of parameters where FTs may not hold or 
need be expressed differently. We explain the relation between classical and quantum FTs and the advantage of this 



We advise against calling this a non- Markovian environment, because non-Markovian refers to stochastic processes, not systems. Instead, 
use, e.g., colored noise environments, which can engender non-Markovian dynamics in the open subsystem. 
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micro-physics open-system approach over the phenomenological modeling and energy-level calculations for substitute 
closed quantum systems. 



II. KEY POINTS AND MAIN IDEAS 



Because we are seeking A) a derivation of quantum fluctuation theorems in nonequilibrium physics by applying 
concepts and practices in B) quantum foundation and measurement theory via decoherent histories and environment- 
induced decoherence with its ensuing classical stochastic equations it might be useful to give a brief summary of the 
key ideas and procedures in this section for ease of cross-reference. For good reviews on these subjects we mention 
for A) and 19, 20, 27] for B). Readers familiar with A) can skip the first subsection, readers familiar with B) can 
skip the last subsection. Readers familiar with both please go to the next section. 



A. Fluctuation Theorems 



1. Classical FTs 



We briefly review the premises of these theorems in classical Hamiltonian dynamics ^. Consider a classical system, 
whose dynamics is governed by the Hamiltonian H(\t). A is a deterministic parameter with a prescribed time 
dependence. At some initial time Iq which without loss of generality can be taken to be zero, the system is prepared 
in a thermal state exp(— (Ao))/.^o- Then the parameter A is changed according to a protocol up to a final time r. 
Work done during this process is defined as ^ 



W^l d,-A(,). 



(1) 



where an overdot denotes derivative with respect to time. Although the Hamiltonian dynamics of the system is 
entirely deterministic, due to the probabilistic nature of the initial conditions that are sampled from the thermal 
phase space density, work is described by a probability distribution V{W). Note that thermal equilibrium is only 
assumed at t = as part of the preparation. In general the evolved system is not in thermal equilibrium. Jarzynski 
equality is the statement: 

(e-^>^) EE J AWV{W)e-P'^ = e"^^^. (2) 

Here Ai^ = — Fq, where Fq and Ft are free energies of the system at thermal equilibrium at inverse temperature 
/? with the parameter A assuming values Aq and A,- respectively. Eq.Q is remarkable in that it relates an average of 
a thermodynamical quantity over nonequilibrium processes to strictly equilibrium properties. 

For the statement of Crooks's fluctuation theorem one defines the reverse process in which the system is prepared 
initially at i = in the thermal state exp(— /3iJ(A,-))/2',- and the parameter A is changed in a time- reversed manner 
to assume the value Aq at t. The probability distribution of work associated with this process is denoted by VaiW). 
Crooks's fluctuation theorem states: 



Vr{-W) 



^P(w-i^n^ (3) 



where the subscript F stands for forward process and A_F is deflned as before. The Jarzynski equality follows from 
Eq.(l3]) by multiplying both sides by VR{—W)e~^^ and integrating over W. 



2. Quantum FTs 



The main difficulty in formulating fluctuation theorems for quantum mechanics is defining work. Except for closed 
systems there is no agreement on a definition of work in quantum mechanics. For closed systems there is general 



* For a recent review on classical FTs see |2S|| . 

^ For a discussion of various definitions of work, their relationship to each other and how that affects the content and context of the 
fluctuation theorems see 0|. 
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agreement on the following operational definition: 1) Measure the energy of the system using the Hamiltonian initially 
at t = to be E'^, thus 'collapsing the wavefunction' to one of the eigenfunctions of the Hamiltonian at the initial time: 
H{0)\ip^) = E^\ip^). 2) Let the system evolve under the time dependent Hamiltonian according to the prescribed 
protocol. 3) At the end of the protocol measure the energy of the system using the Hamiltonian at i = t to be 
thus collapsing the wavefunction to an eigenfunction of the Hamitonian at r: H{t)\iP^^) = E^-^\ip^). Work for this 
specified realization is defined as W — E^ — i?" . Since the system is closed one can interpret the change in energy of 
the system as work performed on the system. In classical mechanics of isolated systems work acquires a probabilistic 
feature only due to the sampling of the initial conditions, since the dynamics is deterministic. In quantum mechanics 
work acquires an additional probabilistic feature from the dynamics: 



where the subscript H indicates Heisenberg operators. Jarzynski equality and Crooks's fluctuation theorem can be 
proven in a few lines for a closed system with this definition of work. 

In this paper we develop an alternative approach based on a microscopic model using the open quantum systems 
paradigm. First consider a classical harmonic oscillator, without a bath. Initial position and momentum of the 
oscillator are sampled from the thermal phase space density. The rest of the trajectory is entirely determined by the 
protocol of how the external force is applied. Work is calculated using this deterministic trajectory according to eq.([T|). 
However, deterministic trajectory is strictly a classical notion and cannot be applied to a general quantum mechanical 
system. A state that is sampled from the thermal density matrix in general does not have a well defined position and 
momentum. Furthermore the time evolution usually causes the wavefunction to spread further. We cannot talk about 
the quantum oscillator being at one point in space having a certain velocity and moving in a deterministic continuous 
trajectory as a function of time. 

Next consider the same classical model with a heat bath. For each realization of the protocol, the initial data for 
both the system oscillator and the bath are sampled from the initial phase space density. The initial data for the 
bath determines the noise for that particular realization. The system oscillator follows a trajectory determined by a 
combined action of the deterministic force /(t) and the stochastic force £^{t). Although the noise is stochastic, each 
realization of the experiment corresponds to a unique noise and hence a unique trajectory. The definition of work in 
terms of trajectories is unaffected. 

It is a simple yet subtle and deep point how the interaction with a bath would help to define a trajectory for 
a quantum particle. To understand this conceptually we adopt the decoherent or consistent histories viewpoint of 
quantum mechanics as described below. 



Trajectories which are well defined in classical mechanics are generally ill defined in quantum mechanics except 
under certain conditions. We shall spell out these conditions here. Let us begin with something simple, such as a 
quantum particle in motion. 

In a closed quantum system S, namely, a system subjected to no outside (environmental) influence except for its own 
quantum fluctuations, the closest entity to its trajectory is a wave packet moving with a certain group velocity but 
that also spreads in time due to the Heisenberg uncertainty relation between the variance of the canonical variables, 
position and momentum in this case. The same system at a finite temperature is no longer closed because for it to 
exist at finite temperature it must be or have been in contact with a source with energy exchange or a bath B kept 
at non-zero temperature. The influence of the environment E (we call an E a bath B if it is described by a thermal 
density matrix with inverse temperature /3) has complicated and interesting consequences. This is the subject of open 
quantum systems. 

There are at least two major effects an environment brings in 'opening up' a closed quantum system: a) it turns the 
original Hamiltonian (unitary) dynamics to dissipative (nonunitary) dynamics - this refers to energy flow from the 
system to the environment, b) fluctuations in the environment decoheres the quantum system - this refers to quantum 
phases of the system being dispersed into the environmental variables. The latter is responsible for shaping the notion 
of trajectories in quantum system and there are precise conditions pertaining to the features of the environment (e.g., 
ohmic spectral density, high temperature) whereby it becomes physically well-defined in a measurement. One way is to 
construct the reduced density matrix of the open quantum system and look at whether and how quickly its off-diagonal 
elements decay in time, leaving the system's statistical state describable by an approximately diagonal density matrix 
with respect to some physically meaningful basis (related to measurement instruments and interaction, such as Zurek's 
'pointer basis' [1^). This time, called decoherence time, marks the appearance of classical features, because after it is 
effectively decohered this open system is adequately described by probabilities rather than amplitudes, its quantum 




(4) 



B. Trajectories in quantum mechanics 
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phase information is lost (more accurately, dispersed into or shared by the multitude of environmental degrees of 
freedom). This process is captured by the stochastic equations, the most common forms are the master equation, the 
Langevin and the Fokker-Planck equations. 

What distinguishes these equations is the presence of noise or fluctuations in the environment, and dissipative 
dynamics of the open (reduced) system, depicting the two distinct features of open system dynamics. In general two 
kinds of noise exist in any quantum system, the intrinsic quantum noise entering in the Heisenberg relation which 
exists for all systems even at zero temperature, and thermal noise from a finite temperature bath. Both contribute 
to decohering a quantum system although the thermal noise usually overwhelms. 

There are many ways to characterize a quantum system as approaching its classical limit. The familiar cases are the 
correspondence principle, the Bohr-Sommerfeld rules in quantum mechanics, the description of Maxwell-Boltzmann 
distribution as limits of the Fermi-Dirac and the Bose-Einstein distributions, or the more simplistic /i — >■ or 'at high 
temperature' stipulations. One can show that the coherent state is the 'most classical' of quantum states [l^. One can 
derive an uncertainty function at finite temperature [sO] or equivalently calculate the entropy function and be able to 
demarcate the transition from the quantum noise- dominated regime to the thermal noise- dominated regime. There 
is significant advance in the last two decades in our understanding of the quantum classical correspondence. (See e.g., 
[Slj ) Decoherence is at the heart of the quantum to classical transition issue, and the main cause of it is noise of all 
forms, either in the fluctuations of the environment, or in the separation of neighboring coarse-grained histories, and 
in the accuracy of the measurement devices and procedures. We will use the decoherent or consistent history |18l - [20j 
viewpoint for conceptual clarity, especially pertaining to the issue of trajectories but adopt the environment-induced 
decoherence (envdec) scheme for computations, as it is technically easier to manipulate. 



1. Decoherence Functional in Dechis and Influence Functional in Envdec 

The main idea of dechis approach is to define a history a by a set of projection operators Pa{tk) acting at times 
tk- As a special case we consider projections in position basis. These kind of histories are naturally implemented in 
the path integral approach. The projectors are represented by window functions Wa [x{tk)], which take on unit value 
if the instantaneous configuration satisfies the requirement of the history a, and vanish otherwise. As a limiting case 
we mention a fine-grained history, for which the path is specified exactly at all times and is assigned an amplitude 
exp(zS'/?i) as usual. It is useful to define the decoherence functional of two histories a and /3 by (22i] : 

The product over k and I can be discrete or continuous as is the case in Section (jlll A[) . The probability of a given history 
a is given by the diagonal element of the decoherence functional: P[a\ = T^la, a] . For classical trajectories it is required 
that the probability of a coarse grained history to be the sum of its constituents. For an arbitrary set of histories 
quantum interference effects lead to a violation of the probability sum rule: P[a\/ /3] — I?[a, a]-f /3]-|-2ReI?[Q;, /3] ^ 
P [a] 4- P . If a set of histories can be identified for which the real part of the off-diagonal elements of the decoherence 
functional vanishes (or are much smaller than the diagonal elements for approximate decoherence), probabilities can 
be assigned to individual histories. The challenge is to identify the conditions under which, and to what extent, the 
decoherence condition is satisfied. 

Technically the environment-induced decoherence (envdec) program is easier to implement, the relation between 
these two programs are explained or illustrated in [l5!,[26|- This is what we will do by way of the QBM model presented 
in the next section. We will argue that for histories obtained by coarse graining the environment sufficiently, and the 
system of interest to some extent (determined by the strength of noise), an approximate decoherence condition can 
be satisfied to a specified degree of accuracy. At the other end, if quantum interference between particle histories 
continues to play an overbearing role, decoherence is not consummated, the classical world is not reached and the 
concept of trajectories is ill-defined. 

The quantum open system formulation, via the influence functional, provides one with a clear perspective in the 
organic relation between the processes of fluctuations / noise, correlation, decoherence and dissipation and how they 
enter in the transition from the quantum to the classical world with the intermediate stochastic and semiclassical 
regimes. While it is useful to explain this with the aid of stochastic equations which we will derive below, the key 
idea can be put succinctly: The stronger the effect of noise in the environment the more efficient it decoheres the 
quantum system and the clearer the classical notion of trajectory can be defined and used for the description of a 
quantum particle. The important new understanding is the existence of a stochastic regime between the quantum 



and the classical, and how quantum features are expressed in terms of classical stochastic variables 



2,. Worldlme Influence Functional Formalism 



Thus far we learned that the decoherence of a quantum system due to the noise arising from a coarse-grained 
environment is instrumental to the emergence of a classical world. How strongly the system is coupled to its environ- 
ment (s), the nature of the noise from the environment and its temperature all enter in determining how completely 
the system is decohered, and there is always a stochastic component in the open system's dynamics governed by a 
Langevin equation or its (near) equivalent master or Fokker-Planck equations. Almost complete decoherence is a nec- 
essary condition for a classical description which in this context, is what trajectories are predicated upon. Under this 
condition a powerful approach called the worldline (WL) influence functional (IF) formalism has been used effectively 
for more than two decades in nuclear / particle physics communities, see e.g., [sSj] . We shall only mention its key 
features so as to bring out its relevance to the present problem but skip all the details. 

The influence functional technique of Feynman and Vernon or the closely related closed-time-path effective 
action method of Schwinger |34l] and Keldysh [ssj are initial value (in-in) formulations which are particularly suitable 
for exploring the time evolution of many body systems, unlike the S-matrix (in-out) formulation used for calculating 
scattering processes. In general this yields a nonlocal and nonlinear coarse-grained effective action (CGEA) for the 
system's motion. The CGEA may be used to treat the noncquilibrium quantum dynamics of interacting particles. 
Take for example the QBM model: When the particle trajectory becomes largely well defined as a result of effective 
decoherence due to interactions with the environment, with some degree of stochasticity caused by noise, the CGEA 
can be meaningfully transcribed into a stochastic effective action, describing stochastic particle motion. The evolution 
propagator for the reduced density matrix of the open system is dominated by the particle trajectory giving the 
extremal solution of the real part of the CGEA. Stochastic fluctuations around the decohered semiclassical trajectories 
are described by the imaginary part of the CGEA. For further technical details, see 136, 131 ■ 

When the back-action of the environment is taken into account the dynamics of the open system will in general be 
non-Markovian as it contains memories, and the noise in the environment is generally colored, as it contains many 
time scales characterized by its spectral density and vary with temperature. Dissipation in the open system dynamics 
is controlled and balanced by the noise in the environment as manifested in the existence of fluctuation-dissipation 
relations between these two sectors. What is more important, because the influence action includes the back-action 
of the environment in a self-consistent manner, the worldline is not merely a prescribed classical entity, or a simple 
solution to an equation of motion at the tree level (in truth, with an ever-present stochastic component), but rather, 
a dynamical one, as the result of constant negotiation between the open system and its environments at all times. 
This is the special beauty of the IF method. 



III. THE QBM MODEL 



In this section we describe the salient features of the bilinear QBM model with a general environment following [17 1 
for non-Markovian dynamics and write down the solutions of the Langevin equation following [ssj . We focus on the 
stochastic dynamics of the quantum open system, which incorporates the effects of the environment. This will play a 
crucial role in our formulation of FTs in the following section. 

A closed quantum system can be partitioned into several subsystems according to the relevant physical scales. If 
one is interested in the details of one such subsystem, call it the distinguished, or relevant system, which interacts 
with the other subsystems comprising the environment, the details of which are not of interest, one can coarse-grain 
the information in the environment but keep its overall influence on the distinguished subsystem of interest, thereby 
rendering it an open system. This influence is best captured by the influence functional technique of Feynman and 
Vernon |32| which we use here. Let us assume for simplicity the system S is comprised of a simple harmonic oscillator 
with position and momentum {x,p) linearly coupled to a heat bath B consisting of N harmonic oscillators with 
positions and momenta {qn,Pn) with n = 1, ..N and allow the system to be driven by a time-dependent external force 
f(t). The Hamiltonian describing the dynamics of the combined system is given by: 

Ht = (Hs) + [Hb +Hi + Hr] , (6) 



A famous case is the transcription of Gaussian quantum fluctuations in the environment as classical noise via the Feynman- Vernon 
identity [3||. 
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where 



[Hb +Hi + Hr, 



p2 1 
2 



AT 

E 

n=l 



m„ 2 V mnUJn 



The system oscillator is coupled to the bath via the linear interaction term Hj = (X)n '^nQn)x. A renormalization 

2 

of the potential via Hr = 2m^u'^ preserves the physical (observed) frequency of the system oscillator for any 
system-bath coupling as will be shown below. Without the renormalization term the potential might have no minimum 
and the thermal state could not be defined. The remainder in the square bracketed quantity in the above equation is 
Hb- This is the QBM model. 

The QBM model is used extensively in the open quantum systems literature thanks to its exact solubility and 
its generality. The solubility is due to the linearity of the model. The generality may not be immediately obvious. 
Representing the environment by a set of simple harmonic oscillators might appear to be a serious restriction to weak 
influences on the system, because of its linearity. An argument for the generality of the model is given by Caldeira 
and Leggett ^. The applicability of the model is limited to cases where the influence of the system on each bath mode 
is weak. This does not imply that the influence of the bath as a whole on the system is weak as well. The Brownian 
particle interacts with a very large number of environmental degrees of freedom. The effect of these interactions can 
add up to yield strong dissipation, fluctuations and decoherence for the Brownian particle. 

The combined system being closed, the Hamiltonian Ht gives unitary evolution, its density operator p obeys the 
von-Neumann equation 

^n^^[HT.p{t)]. (8) 

An alternative description closer in spirit to (but should by no means be identified with) that of a trajectory in phase 
space which gives a full and equivalent description is by way of the Wigner function 40] . For a closed system such as 
S by itself, without any interaction with its environment, yV(X,p, t) is defined with the new variables X = (x + .x')/2 
and y = x' — x: 

W{X,p, t) = ^J dye^PypiX - y/2, X + y/2, t). (9) 

Because of its appearance in phase space variables it is often said that the Wigner function is the quantum corre- 
spondence of the classical phase space density [4l[ and the peak of the Wigner function coincides with the classical 
trajectory in phase space. This is an erroneous statement. Wigner function gives as complete a description as that 
provided by the density matrix because it contains full quantum phase information. As such it can take on negative 
values ^ . 

However what we are interested in is how the system S behaves under the influence of its environment, in this 
case a heat bath B at temperature The state of the open system at any one time is completely specified by the 
reduced density matrix pr-, which is obtained from the density matrix of the combined system by integrating out the 
bath degrees of freedom. In position representation it is given by: 

Pr{x,x',t)^ j '^dqnp{x,{qn},x' ,{qn},t). (10) 



"For most cases of interest, at least when the system variable is macroscopic, this assumption is physically reasonable; in that case 
the environment is usually also (geometrically) macroscopic and the interaction of the system with any one environmental degree 
of freedom is general ly p roportional to the inverse of the volume, while the characteristic energy of such a degree is of freedom is 
volume-independent." [39l | 

Under special conditions for Gaussian systems such as a free simple harmonic oscillator (closed system) or one which interacts bilinearly 
with an ohmic bath at high temperature (an open system) the Wigner function is positive definite for all times. The quantum and 
classical dynamics have the same form in the equations of motion '42:j . For more general conditions by including environmental influence 
the reduced Wigner function (defined later) may become positive definite at late times after the system has sufficiently been decohered. 
This can indeed be used as a criterion for the appearance of classicality and the condition for the trajectory notion to be safely adopted 
in a quantum open system. 
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Because it incorporates the back-action of the environment the time evolution of the reduced density matrix of the 
open system is nonunitary and in general non-Markovian. The reduced density matrix of the system oscillator at tf 
can be obtained from the reduced density matrix at some earlier time U via p3| : 



Pr{Xf,x'j:,tf)= J dXidx'^J{xf,x'j:,tf;Xi,x'^,ti)pr{Xi,x'^,ti), (11) 

where J is the propagator. If the system and the bath are initially uncorrelated and the bath is in a Gaussian state 
the propagator J can be calculated exactly: 

px{tf)=Xf „x'(tf)=x'f ^ 

J{xf,x'f,tf-x^,x[,U)= Dx Dj.'Qi{Ss[x\-Ss[x\+s,A^,x])_ ^^2) 

J x{ti)—Xi J x' {ti)—x'^ 

Now introduce the following notation: for functions A{s),B{s) and kernel K{s,s') define 

A-K -B- r ds r ds'A{s)K{s, s')B{s'). (13) 



In terms of the new variables the exponent appearing in Eg. (1121) can be written as: 

Ss[x]~Ss[x'] = -MX{tf)yf + MX{U)y,+yLo-X, (14) 
Sif[x,x'] = -y ■ n ■ X + -y ■ ly - (15) 

where Lo(i,i') = -^(^ + ^'^)S{t — t'). The kernels fi{s,s') and iy{s,s') are called the dissipation and noise 
kernels, respectively. For the special case, when the heat bath is in a thermal state of the bath Hamiltonian 

= Yln=i 2^ + h^n^n^n : t^cse kcmels are given by: 



N 



n=l 



{t,t') = y ^^sm[ojn{t^t')]e{t~t'), (16) 



N 2 Of. 

= ^-^coth(^)cosK(t-i')]- (17) 

n—l 

In the equivalent description in terms of the Wigner function one defines a reduced Wigner function Wr in terms 
of the reduced density matrix formally in the same way as in Eq. (denoted by a subscript r). Using eas.([ WT^ it 
can be show that the reduced Wigner function evolves from time to a later time tf via 

If r r^itf)=Xf-yf/2 i-x'(ts)=Xs+ys/2 

Wr{Xf,pf,tf) = — / dyfe^P^yf / dx.dx', / Dx / Dx' 

^^/i J J Jx{t,)=Xi Jx'{ti)=xr 

^^^{Sslx]-Ss[x']+S,Axy]) f ^p^^-iM-',-^)^^^^l±^^p^^t,). (18) 



First we perform a functional change of variables from the variables x{t),x'{t) to X{t) = {x'{t) + x{t))/2, y{t) — 
x'{t) — x{t). We also perform a regular change of variables from Xi,x'^ to Xi = {x[ — a;i)/2, = .t'- — Xi. The Jacobian 
determinant for both change of variables is one. Then we use eqs. ()14|15p and define L = Lq — fi to obtain: 

Wr{Xf,pf,tf)^ J dX, J dp,Wr{X„p,,U)^ J dyfe^Pfyf J dy^e-^^^^^ 

y(tf)=yf „X(tf)=Xf 

Dy / jjj^^j-{-MX{tf)yf+MX(U)y,+yL-X-^yv,.y)^ ^^g^ 

y{ti)=y, Jx(u)=Xi 
The functional integral over y is Gaussian and can be evaluated formally to give: 



y(if)—yf / 1 

Dyei^y'^-''-^y''-y^ ^ J^^, — e-^(^-^^^--'-(^-^\ (20) 

y{ti)=y, V det{v/2'Kh) 



10 



For the type of noise kernels displayed in Eq. (IT7|) the outcome of this functional integral is independent of the endpoints 
Ui and yf, irrespective of the distribution of bath frequencies. As a result the integral over yi and yf is trivial and 
gives {2'Knfd{MX{U) - p,)S{MX{tf) - pf). We have 

miXf,Pf,tf) = ^^^^^^^^^^^^ / dX, J dp,Wr{X,,p,,U) 
X / DX{2Trh)^S{MX{U) - p,)S{MX{tf) ~ pf)e-i^^-^^^<'"'1 (21) 

Jx(ti)=Xi 

Next we do another functional change from X{t) to ^{t) where 

X{t) ^ {X, = XiU), p, = MX{U), at) = (L • X){t)}. (22) 

For linear change of variables the Jacobian functional determinant is independent of ^. To ensure that the boundary 
condition at tf is satisfied we need to place a delta function inside the new path integral. The net effect of the 
functional change of variables is: 

DX5{MX{U) ~pi) ^ / Di5{X^{tf)-Xf), (23) 

X[ti)=Xi J 

where X^{t) is the solution of the Langevin equation [L ■ X^){t) = S,{t) with the initial conditions [Xi^pi). After this 
functional change we obtain: 

yVr{Xf,p},tj) = j dX^ j dp,Wr{X,,p,,U) 

--e-i^^-'-''-^''-^6iMX^{tj)~pf)SiX^itf)~Xf) 



det(2iTfiv) 

dX, j dp,Wr{X,,p,,U) j DiP[i]5{MX^{tf)-ps)5{X^{tf)-Xf) 
[s{MX^itf)-pf)SiX^itf)-Xj)) (24) 

Here ^t) is a random noise with Gaussian statistics and is characterized by its mean and variance: 

m) = 0. (25) 

mm) = Mt.t'). (26) 

Furthermore since the system and bath are assumed to be uncorrelated initially: 

{Xm) = {P^m) = 0. (27) 



Eq. ([24| has a clear interpretation. The dynamics of the reduced Wigner function is identical to the dynamics of the 
phase space density of a stochastic classical system described by the Langevin equation {L ■ X^){t) = ^(t). 

As argued in [3a] the Langevin equation provides a more detailed description of the dynamics than the master 
equation, in the sense that the class of quantum correlation functions which may be retrieved from the Langevin 
equation is larger than the corresponding class for the master or Fokker-Planck equations unless the dynamics is 
Markovian. Work as defined in Eg. pQI) is an example of this kind of quantity, since its statistics requires the 
calculation of multi-time correlations. 

It is important to realize that this method gives exact quantum mechanical results at any parameter regime, 
including arbitrarily low temperatures. The fact that solutions X^ of a classical Langevin equation are used in eq. (|24p 
should not be conjured as having made a semiclassical approximation as was done in e.g. [5|. 

The effect of environment-induced decoherence at work which validates the notion of a physical trajectory is implic- 
itly contained in this method (depending on the temperature of the bath and its spectral density), not extrinsically 
introduced by hand. Since these processes are dynamically and self-consistently determined no semiclassical approxi- 
mation has been made specifically in the derivation. The real challenge is in the interpretation of the physical variables 
in light of quantum measurement theory, as we discussed previously. In the following section we discuss under what 
conditions physical trajectories emerge from the dechis formalism. 
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A. Decoherence Functional 



We consider histories where the system variable X is specified to follow a trajectory with a given accuracy 
CF{t), while the environment variables are left completely unspecified. For technical reasons it is convenient to use 
Gaussian, rather than sharp, window functions w^[x{-)]. In the path integral this roughly corresponds to using 

exp |~ / dt ^^^*2a'^t)'^ } eq.(IS|). Furthermore we introduce window functions at every instance of time rather than 
at discrete time intervals. The set of Gaussian window functions with this property acts as a noise term in the 
influence action. This can be seen in eg. ([25)1 where the noise kernel always occurs in the combination v + (2cr^)~^. 
There is some error introduced due to the overlap of projectors defined as above. As a result we will be talking about 
approximate decoherence. In addressing the diagonal and off-diagonal elements of the decoherence functional it is 
convenient to define U = (x' + x)/2 and u = x' ~ X- In. [3] it is shown that the decoherence functional for two 
histories x(t) and x'(^) defined via these projectors is approximately given by: 

\D[U -u/2,U + ul2]\ - exp|-i(L- f/)'^ • {v + [2(7"^)-^)-^ ■ {L ■ U) - ■ (ly-^ + 2(t^)-^ • u| . (28) 

Here we again used a compact notation as before and v is defined in eq. (|26p . The off-diagonal elements vanish as a 
Gaussian for u ^ V + 2a^. Hence an approximately consistent set of histories can be obtained by picking histories 
that differ by at least this amount. However if the Langevin noise is weak such that ^ ct^, we run into trouble 
because now decoherence condition requires u > ViP^ ^ a. Histories of accuracy cr in a set do not interfere with 
each other only if they are separated by a distance much larger than a. This suggests that we cannot account for all 
probabilities within such a set. 

We conclude that the accuracy should be adjusted to the noise level by: ^ v^^ . Then the decoherence condition 
requires that u ^ a. Now we can have a set of histories which decohere approximately and for which the resulting 
probabilities add up to one. "A picture of the system evolution based on actual nearly classical trajectories may 
only result from a compromise whereby the accuracy of observations is adjusted to the noise level, ^ where 
cr is the accuracy at which the trajectories are defined. Larger noise for a given a means more decoherence but less 
predictability; for a weaker noise, predictability is only limited by the Heisenberg bounds, but individual trajectories 
will not decohere.^ If we are satisfied with predictability within the limits imposed by the Langevin equation, then 
in the strong noise limit we may consider individual trajectories as depicting physical reality." This condition is 
ordinarily satisfied at high enough temperatures where the quantum and classical trajectories agree, even for non- 
Markovian dynamics, as we will see below. 

For a given accuracy a the higher the temperature the stronger the noise and the more effective it brings about 
decohering histories into trajectories. Thus even at moderate temperatures and for relatively weak noise by judicious 
choices of the coarse graining measure a decoherence can be effective enough to warrant the notion of trajectories. It 
is in this regime where deviations from FTs can be identified using this method. At low enough temperatures when 
no reasonable set of histories decohere and the notion of trajectories lacking, we cannot say the FTs are violated (even 
though it appears reasonable to doubt its validity) because the contents of FTs may be phrased without invoking 
trajectories. For completeness of technical presentation we provide a low temperature expansion in section (jV A 2p . 



IV. SOLUTIONS OF THE LANGEVIN EQUATION 

It is convenient to rewrite the Langevin equation as: 

MX^{t) + 2M j^dsl{t-s)X^{s) + M9?X^{t) = f{t)-2Ml{t-ti)X, + ^{t), (29) 
-1 N 1 

,it-s) . ^E^cosK(^-)], (30) 

where 7 is the damping kernel defined as the antiderivative of the dissipation kernel fj, [l7j . It is related to the noise 
kernel by the fluctuation-dissipation relation ([5^ (See [1^, for further exposition of the meaning and respective 
roles of f and 7.) 



We will continue the exploration of this regime in a sequel paper. 
Quotation is from |44|| . p. 89. 
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where 7 is the damping kernel defined as the anti-derivative of the noise kernel v [13. (See m, lie"] for further 
exposition of the meaning and respective roles of v and 7.) It is related to the noise kernel by the fluctuation- 
dissipation relation ([59l) . In the rest of the paper we will drop the subscript ^. The Langevin equation ([29|) is a 
linear integro-differential equation. The effect of interactions of the system oscillator with the bath is contained in 
a nonlocal potential and renormalization of the potential. One can think of the nonlocal potential as the system 
oscillator interacting with its own past, where the interaction is mediated by the bath. A formal solution to this 
equation can be obtained in terms of the homogenous solutions to the LHS of Eg. ip^)) with ti set equal to zero. Let 
us call the two linearly independent homogenous solutions h(t) and g{t) such that: 

/i(0) = 5(0) = 1; /i(O) = g(0) = 0. (31) 
The formal solution of the Langevin equation is then: 

X{i) = X{U)h{t -U)+ p{U)g{t + At'git - t') [f{t') + i{t') - 2MX{ti)l{t' ~U)]. (32) 

h{t) and g{t) can be calculated using the Laplace transforms: 

^ 27(£) + s l/M 

where the hat indicates Laplace transform. These expressions show the relation between the two linearly independent 
homogenous solutions: 

sh{s) = 1- Ain^gis), sMg{s) = h{s) ^2M'l{s)g{s), (34) 

h{t) = -Mn^g{t), Mg{t) = h{t) ~ 2M [ ds7(t - s)g{s). (35) 

A. Initial State Preparation 

The derivation of classical mechanical FTs for closed systems requires the closed system to be in a thermal state. 
As pointed out earlier our derivation of the Langevin equation (|29p assumes an uncorrelated initial state in which 
the bath is in the thermal state of its own Hamiltonian Hb ■ Such a state is obviously not the thermal state of the 
combined system and it is not stationary for any choice of the system's initial state. For this reason the uncorrelated 
initial state is not appropriate for applications to FTs. This observation is valid even for the classical Brownian 
motion model and is therefore not due to a quantum mechanical effect. 

Assume that the bath oscillator frequencies form a continuum. It is customary to define the spectral density of the 
bath as 

J(c.)^^-^<5(c.-^„) (36) 

and interpret J(uj) as a continuous function. The resulting Langevin dynamics is truly dissipative, in the sense that 
limt^oo g{t),"f{t) = 0. Physically, true dissipation corresponds to a positive average heat rate at all times. If the 
spectrum of bath frequencies is discrete, the resulting damping kernel is oscillatory. This is the case even for an infinite 
but countable number of discrete frequencies. As a result after some (possibly very long) time there may be average 
heat flow from the bath into the system. By true dissipation we mean a definite arrow of time for all times. Under 
these assumptions it can be shown that if the uncorrelated initial state is prepared at the inflnite past, for times 
t > the dynamics of the system oscillator is indistinguishable from that of a combined system -I- bath thermal state 
preparation. In other words the effect of a thermal initial state can be achieved by allowing the uncorrelated system 
to thermalize for an infinite amount of time. At t=0 the system density matrix is Gaussian. Means and variances of 
position and momentum are equal to those of the combined thermal state of QBM given in [4^ : 

I °° 1 



M/3 ^f-^ + + 2Ur^{nr) 
M ^ + 2Vr'){Vr) 



r— — 00 
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where i/,. = 2TTr/h[3 are the bosonic Matsubara frequencies. These variances differ from those corresponding to a 
Boltzmann distribution with respect to the system Hamiltonian alone. The differences start at second order in the 
couphng strength between the system and the bath. In the hterature ignoring these differences is sometimes referred 
to as the weak coupling approximation. The results of this paper do not depend upon the weak coupling approximation 
in this sense. 

It is worth emphasizing that the equivalence of ensemble preparations is not just on the level of reduced density 
matrices, which can give only single-time correlations for general non-Markovian dynamics. As pointed out before 
FTs require multi-time correlations which can be obtained via the Langevin equation. It is the equivalence of the 
trajectories for t > that can be shown exactly for the two preparations mentioned. This means that any quantum 
mechanical correlation function involving only the open system variables and times larger than zero will be identical 
in both preparations [l^l . 

As a result the trajectories we obtained in the previous section can be used to describe a thermal state as long as we 
take ti — >■ — oo and assume a continuous spectrum for the bath frequencies. The thermal state preparation procedure 
is as follows: at the infinite past the system and bath are in a product state: the bath is in the thermal state, and the 
system is in an arbitrary state. The combined system evolves in time under the Hamiltonian (|6|) with f{t) ~ /(O) for 
t < 0. At t = the force protocol is started as usual. Although the formulation of FTs is independent of the value of 
/ after t = r, it proves convenient to define /(t) = /(r) for t > t. 



V. PROBABILITY DISTRIBUTION OF WORK AND THE FTS 



With these conceptual and technical preparations we now can define work performed on the system in the time 
interval [0, r] in the QBM model using the trajectories given by the solutions of the Langevin equation ([5^ as: 

lo '^^^ ^^lo '^^^^^^^^^^ r '^^^^^^^^^^ = ■ ^- (^^^ 

In the last equality we utilized the notation of Ea. (ll3|) . where we set the integration limits to plus and minus infinity. 
We will adopt this convention for the rest of the paper. The superscript T stands for transpose. Since we have 
extended the range of integration in the redefined f{t) to the entire real axis (see the end of the previous section) this 
change does not introduce any error in the above equation. 

We define the retarded Green's function as gret{t — t') = g{t — t')9{t — t'). Then for positive times: 

X{t) = [9ref m) + [grefm), (40) 

(A(<)) = [gret-m). (41) 
a^At,t') = {X{t)X{t')) - (A(<)) {X{t')) = [gret ■ fiv ■ gj,t](t,i'), (42) 

W ^ ~f^- gret -f-T- gret ' ^ (43) 

That axx{t, t') is a function of i — i' only will be verified explicitly later. 

Work defined in Eq. pS)) is linear in ^(t) and £,{t) is a Gaussian random process. Thus W itself is a Gaussian random 
variable. As a result the first two moments of W specify its entire statistics given by: 



V(W) ^ — i ^-iW^{W)r/2al. (44) 



The mean of work is given by: 

(W) = ~f^-greff. (45) 
Integrating this by parts and defining AF = -(/(t)^ — /(0)^)/2Afr2^ we get: 

W-A^^ + /^, (46) 

where we have defined he{t,t') = h{[t — t'[) and used the symmetry of the integrand. The standard deviation of work 
is calculated as: 

= {W^) ~ {Wf = • fT,, • /. (47) 
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Jarzynski equality states that: 

(e-^^) = J dWV{W)e-^'^ = e-K(^^-^-w/^) = ^-ffAF-r ^ (48) 

where AFt is the difference in free energy of the combined system for two different values of the external force / 
calculated quantum mechanically. Due to the linearity of the QBM model AFt has the same form as AF defined 

earhcr, which is the classical result. Note that this is only true for the difference of the free energies, since the quantum 
and classical free energies themselves are different even for the simple harmonic oscillator. The quantum mechanical 
free energy in the case of / = is given by: 

1 / \ °^ 2 \ 



r— — oo 



where Fb is the free energy of the isolated bath. The corresponding free energy in the classical model is simply the 
sum of the free energies of the isolated system and bath. 

The equality of the difference of free energies due to a driving force can be understood easily by noting that the 
main effect of the linear driving force is to shift the energy levels. As a consequence Jarzynski equality is satisfied if 
and only if: 

Note that this equality should hold for any f{t). This condition can be stated mathematically as 

oj{s) Jo Jo 



h{\t-t'\) . 



fit') = 0, (51) 



Jo 



dtfit) 



H\t-s\) 



= 0. (52) 



This equation should also be valid for any f{t). Differentiating one more time with respect to f{s') we get the 
condition: 

For Crooks's fluctuation theorem we need to consider the reverse process which corresponds to a reversed force 
protocol and an initial state with the force value /(t). We will use a subscript R for the quantities associated with 
the reversed process and no subscript for forward process. 

fnit) = f{T - t); AFr = -AF (54) 

The corresponding work distribution is again specified by its first two moments, which can be shown to be: 

= {W)-2AF, (55) 

Note that the standard deviation of work is the same for the forward and reverse protocols. The probability distribution 
of work in the reversed process is given by: 

rji{W) = 1 ^-{W-{W)^r/2ia^^)n ^ ^ -2AF)) V2a^ (gg) 



Consider the ratio: 



Crook's fiuctuation theorem is satisfied if 



(W) -AF = (58) 
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As expected this condition is equivalent to the condition (|53p for the validity of Jarzynski equality. 

Let us now try to understand the nature and meaning of condition ([55)) . h and g are solutions to the homogenous 
Langevin equation. As such they do depend on the damping kernel but not on the noise kernel, axx on the other hand 
depends on both the damping kernel via g and on the noise kernel. For this equality to hold there has to be a relation 
between the noise and dissipation kernels. The same conclusion can be reached by studying Eg. (1581) . The average 
of work is independent of the noise kernel, but depends on the damping kernel. On the other hand the standard 
deviation of work does depend on both kernels. 

There is indeed such a relationship between the damping and noise kernels: the fluctuation dissipation relation 
(FDR). It is most easily presented in terms of the Fourier transforms of the corresponding kernels. 

hD{uj) = Mhujcoth{(3huj/2)^{uj). (59) 

However the quantum mechanical FDR in general does not satisfy condition (f53| . and thus the FTs do not need to 
hold. To see this note that the damping kernel is independent of h. As a result the homogenous solutions of the 
Langevin equation, h and g, do not depend on h. On the other hand axx in general is a function of arbitrarily large 
powers of h via the coth term in the noise kernel. FTs are satisfied if h is set to zero. Corrections to FTs is expected 
at 0{h^). 



A. High and Low Temperature Regimes 

As described in the previous subsection, noise kernel is the only place where quantum effects are manifest, as can 
be seen by the appearance of h. Assumptions made on the properties of the bath renders the quantum features 
associated with the initial state of the system oscillator forgotten completely. In FTs the noise kernel appears only in 
the standard deviation of work cr^. In this subsection we will investigate this term in the high and low temperature 
regimes. 

Using the Fourier transform one can show from Eq. (|T7l) that: 

/oo 
diufd{u)axx{uj)fd{-uj), (60) 
-oo 

where fd{<^) denotes the Fourier transform of f{t). Recall that in our convention f{t) vanishes outside the interval 
[0,t], thus the Fourier transform is well-defined. Using the FDR ([5^ it can be shown that: 

1. High temperature expansion 
For frequencies satisfying f5huj < 1, coth can be expanded into a Laurent series: 



k=l 



(3MVi^ (2n)! V 2 / p,M?t^' 



where i?„ is the n'th Bernoulli number. If we assume that either he{io) or /d(aj) decreases sufficiently fast for 
large frequencies such that f3huj > 1, the Laurent series is a good expansion. Hence the characterization of 'high' 
temperature depends on two time scales: the intrinsic time scale of the oscillator (determined by its interaction with 
the bath as well as its natural frequency) and the time scale of the driving force. It is reasonable to assume that 
/le(ijj) vanishes for frequencies larger than the bath cutoff. Usually this is taken to be very large. We will assume that 
fd{^) becomes negligible at frequencies much smaller than this cutoff frequency, denoted as uJh- This is expected to 
be a reasonable assumption for typical driving forces. High temperature refers to the condition (ihuh <^ 1. 

If we keep only the first term in the expansion (|63|) we see that condition ([50l) for the validity of FTs is satisfied. 
Deviations from FTs to all orders of Ti can be calculated to be: 



1 ^ 22»B2„ fisht-^ 



BAin^ ^ (2n)! V 2 

n— 1 ^ ' ^ 



/ • • /. (64) 
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The superscript on hg denotes the order of derivatives taken with respect to the argument. The correction term can 
also be written as: 

l3Mn^ A. (2n)! [2 J ^ ^ ■ 

Note that the knowledge of the homogenous solution to the Langevin equation is enough to calculate the correction 
term to all orders of h. 



2. Low temperature expansion 



Below we present the form of the standard deviation of work in a low temperature expansion but we won't go 
into the details of the low temperature expansion because the notion of trajectories will ultimately break down at 
sufhciently low temperatures. For high frequencies the following expansion of coth is more suitable than Ea. (j62p : 



coth 



sgn(a;) 



k=l 



(66) 



\uj\he{uj) 



2E< 

fc=i 



-kl3h\u:\ 



(67) 



This expansion is convergent for all frequencies. However convergence is fastest for phuj 3> 1. If we assume that 
either h^iuj) or fd{oj) decreases sufficiently fast for a; — >■ such that f3Tiuj < 1, expansion (|67p is a good one to use for 
Ea. (j60p . Hence the characterization of low temperature depends on two time scales: the intrinsic time scale of the 
oscillator and the time scale of the driving force. It is reasonable to assume that he{uj) vanishes for frequencies lower 
than the lowest bath frequency. Usually this is taken to be very small. We will assume that fdii^) becomes negligible 
at frequencies much higher than the lowest bath frequency (This condition can be violated by a very slowly changing 
driving force). Let us denote this frequency by w/. Low temperatures are defined by l3Tiuji 3> 1. 



3. High temperature conditions and Markovian Dynamics 

An important special case is the Ohmic bath characterized by the spectral density: 

j(^) ^ (68) 

Without a high frequency cutoff, the damping kernel becomes local in time. The Langevin equation takes on the 
form: 

MX(t) + 2MloX{t) + M9?X{t) = f{t) + (,{t). (69) 

Physically one would like to have a high frequency cutoff, which in turn makes the damping kernel nonlocal in time. 
The high frequency cutoff also cures the pathologies of the noise kernel that occur in the Ohmic case without cutoff. 
A large cutoff A ensures that the damping kernel is strongly peaked around zero. If the driving force f(t) doesn't 
change significantly on time scales of order 1/A, the Markovian approximation can be justified. 

However, Markovian dynamics is not the criterion for FTs to be satisfied, high temperature is. This is because even 
at high temperature if the bath is non-Ohmic the dynamics of the open system can be non-Markovian. 



VI. RELATION BETWEEN CLASSICAL AND QUANTUM FTS 



It is a well known fact that the dynamics of a quantum system with a quadratic Hamiltonian is identical to the 
classical dynamics of the same model [i^ . This applies to QBM model as well. One may wonder if FTs are satisfied 
in classical dynamics, with the above observation, what is it then that causes the possible violation of QFTs at low 
temperatures? Although the dynamics is the same for quantum and classical models, initial conditions are not. The 
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thermal state at low temperatures is different for both. The damping kernel does not depend on the initial conditions 
and thus is the same for both quantum and classical models. The noise kernel on the other hand depends on the 
initial state of the bath. As a result it is the noise kernel that is different and could give rise to deviations from FTs. 

In the previous section we have seen how the classical limit is reached at high temperatures. We identified high 
temperatures as the ones such that all the relevant bath modes are multiply occupied. By relevant bath modes we 
mean those that are within the range of frequencies of the external driving force. As is well known from elementary 
quantum mechanics multiply-occupied harmonic oscillators act classically. In this classical limit FTs are satisfied. 

Alternatively one can solve the classical version of the QBM model exactly, which is possible due to the linearity of 
the model. Moreover in the classical model one can use the thermal state of the combined system instead of resorting 
to the infinite time preparation^^. The result is a Langevin equation in which the noise is correlated with the initial 
conditions of the system oscillator. One can define a new noise which is uncorrelated to the initial conditions of the 
system oscillator. This redefinition also gets rid of the slip term [4^ in the Langevin equation and one obtains 
the familiar form: 



MX{t) + 2Mj dsl(t~ s)X{s) + Mn^X{t) ^f{t)+^{t), (70) 

m) =0, (71) 
mm) ^'-fi{t-t'), (72) 

{x,m ^{mt)) = o, (73) 

where the initial conditions are sampled from the reduced phase space density of the system that is obtained from 
the thermal phase space density of the combined system by integrating out the bath degrees of freedom. 

Eqs. (|70ll73)) arc the beginning point of the analysis of _49J. The authors of that paper start with the phenomenological 
Langevin equation that is identical to ([70]). They further assume a Gaussian noise with the classical FDR ([72l) . Finally 
they assume that the initial values of the system oscillator coordinates are sampled from the classical phase space 
density fs{Xi, Pi,ti) cx exp[—l3Hs{Xi,Pi,ti)]. This last point can be justified from the microphysics model: 

N 



n=l 

(X exp[-/3Hs] Y[ / dx„i / dp^ exp < ( X! + 2™"^ 

n— 1 I, \n— 1 L " 



1 

X, 



cx exp[-/3i/s(X„P„t,)]- 



Similarly the change in free energy that appears in Jarzynski equality and Crooks's fiuctuation theorem is that of the 
combined system. However, the construction of the coupling and the renormalization term makes it coincides with 
that of the isolated system oscillator. This clever scheme notwithstanding, we point out that in their phenomenological 
approach 49] the free energy difference is mistakenly interpreted as that of the free oscillator, since there is not enough 
information to track down its origin. This kind of ambiguity and disconnectedness often found in the phenomenological 
models in the literature heightens the importance and advantage of using a first-principles approach based on micro- 
physics models, as is adopted here. 

Starting from a microscopic model we were able to recover all the features of the phenomenological Langevin 
equation. From there on, using the same analysis as in (49j leads to the verification of FTs. However, it is crucial 
to make the following distinction: In the phenomenological theory there is no a priori reason why FTs should hold 
because the open system dynamics is not Hamiltonian. As a result one needs to show the validity of FTs explicitly. 
In our formalism, on the other hand, we start with a closed (system -I- bath) Hamiltonian system in a thermal state 
(of the combined system). Hence all the premises of the FTs are satisfied and one expects that they should hold. 
What needs to be done is to verify them from explicit calculations. 

One might object to this claim by noting that an uncountably infinite bath is required for the preparation described 
in section pV Ap . The proof of FTs for close Hamiltonian systems utilizes the Liouville theorem, for which we have 
seen only proofs for finite number of degrees of freedom. In this sense our model, with infinite preparation time also 
doesn't trivially satisfy FTs, and needs the explicit verification. On the other hand for finite baths one can use the 
thermal state of the combined system at t=0 and then the FTs follow trivially. This second procedure is very easy 



Like the quantum model, in the classical model too the equivalence of both preparations can be proven exactly for any spectral density. 
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for the classical model though somewhat complicated yet still straightforward for the quantum model. The important 
point is that the infinite time preparation is only introduced for technical convenience. It can be argued that for any 
relevant times t > Q the effect of an infinite bath can be approximated arbitrarily closely by a large but finite bath. 
Hence our results are insensitive to the unphysical assumptions about the bath we made in our derivation. 

It is worth mentioning that Speck and Seifert ^50J have shown that the Jarzynski relation holds for general classical 
ergodic systems governed by stochastic dynamics including non-Markovian processes. Ohkuma and Ohta [5l| studied 
classical systems described by a non-linear, non-Markovian Langevin equation with Gaussian colored noise. Both of 
these works are more general than our work when applied to classical systems because they are not restricted to linear 
models. On the other hand both adopt a phenomenological approach without an underlying microscopic model, as 
we do. 



VII. DISCUSSION 
A. Comparison to previous worlc 

As mentioned in section ll A al there seems to be a consensus on how to define work in closed quantum systems 
Work is defined as the difference of the energy of the closed system measured at two different times. This method is 
less attractive when applied to open systems (treating the system-|-environment as the closed system) since it involves 
measuring the energy of the combined system. Furthermore work is restricted to the open system, and it is only a 
part of the total energy which involves also heat exchange with the bath. This can lead to big errors if one calculates 
the work of the combined system since work is the difference of two large numbers. 

In this paper we the use the decoherent history conceptual framework to explain how the notion of trajectories in 
a quantum system can be made viable and use them to define work for open quantum systems. These quantities are 
likely to be more easily accessible than the energy levels for practical purposes related to experiments, especially for 
open quantum systems. The classical mechanical definition of work in terms of trajectories is used in the formulation 
of FTs. 

Work operator is another route taken Q but there is no satisfactory definition of work as an operator Q. Besides, the 
work operator approach does not place any limit on the range of validity of its predictions. Using the environment- 
induced decoherence scheme we can assess how strong the noise in the environment need be to provide sufficient 
decoherence to warrant the use of trajectories so as to be able to define work in open quantum systems. The 
parameter range whereby this condition is not satisfied is likely related to the range where FTs may not hold quantum 
mechanically. The question of whether deviations from FTs can be observed in low temperature experiments at all, 
and if so in which parameter range, requires more quantitative analysis. This will be treated in a sequel paper. 

Comparing with previous work in the literature the approach of [sj is closest to ours in spirit. However, in substance 
our approach differs from theirs in several important ways, as numerated below. Foremost a theoretical justification 
of the use of and the derivation of the range of validity of the trajectory concept in quantum mechanics are necessary 
in the formulation of FTs. To this end the authors of Q invoke continuous measurements and wave function collapse 
together with taking the semi-classical limit. We point out the key conceptual and procedural steps which we believe 
are flawed. 

a. Conceptual flaws It is said in |5j| that "the classical limit can be reproduced by using the Wigncr function". 
Also, "Q+ (Our X) is a classical coordinate variable and Q- (our y) is a quantum coordinate" 

These wrong statements stem from, we believe, a lack of understanding of the central issues in quantum decoherence. 
Misconceptions like these were common but were addressed and clarified in the 90s. See e.g., (isl. l4l|. 

b. Quantitative differences The range of validity is not stated clearly in 5] and the generating functional of work 
given in their Eq.(9) is said to be valid at arbitrary temperature. We believe this is an overclaim. 

In the dechis or envdec formalism trajectories emerge due to the influence of the environment, in particular, the 
strength of noise: The stronger the noise the more pronounced trajectories take shape, the weaker the noise, the more 
quantum features prevail. These conditions of classicality can be quantified clearly and from them one obtains the 
criteria for determining the range of validity of quantum FTs as we discussed in an earlier section. 

Eq.(13) of [5] gives the lowest order in h correction to the Jarzynski equality. We provide the corrections to arbitrary 
orders of h in our Eq. (j65p in terms of the homogenous solutions to the Langevin equation. Furthermore we show that 
these corrections apply to both Crooks's fluctuation theorem as well as Jarzynski's equality. At the classical level we 
derive Crooks's fluctuation theorem and Jarzynski's equality for the Brownian motion model. 
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B. New issues brought forth 



The dechis and envdec approach bring forth a number of new issues which were not so clearly noted before. We 
name three here. 

c. Initial state preparation Initial state preparation is an important aspect of FTs. Most of the literature on 
FTs for closed systems is usually clear on this aspect. However a certain level of ambiguity exists in open system 
treatments. In this work we considered an initial thermal state for the closed system made up of the subsystem 
plus its environment. However for computational ease and clarity of exposition we developed an equivalent initial 
state preparation method based on product initial states for the system and the bath. Our initial state preparation 
replaces the system's dependence on the initial state by the properties of noise statistics. As a result our preparation 
method has only one probabilistic element as opposed to two. This makes the analysis clearer and the identification 
of quantum effects easier. 

d. On the meaning of the average in Eq.^. The averages that are calculated using the statistics of noise can 
alternatively be expressed in terms of expectation values of quantum mechanical operators. The important point 
is that products of position and momentum operators need to be symmetrized owing to the properties of Wigner 
function, which is used in the averaging process. In the specific case of Jarzynski equality, we observe that the average 
over noise realizations can also be obtained by taking the expectation value of the quantum mechanical operators as: 



In this special case symmetrization is achieved by the exponential function together with the fact that the dynamics 
is linear and work itself is a linear function of position. Consequently we don't need to impose the symmetrization 
procedure explicitly. It is in this strict sense that the results that are obtained using the work operator W = 
— dtf{t)xH(t) — Hh{t) — Hh{0) for Jarzynski equality agree with our results obtained via trajectories. 

e. How to decide if possible violations to FTs can be observed? The formulation of FTs involves averages over 
noise realizations, with idealized situations where trajectories are perfectly well resolved for each realization of noise. 
But of course in an experiment, even classically, there is only finite resolution. Let us assume that the resolution of 
the experiment is independent of temperature. This introduces an error to the FTs obtained from this data that is 
independent of the temperature. 

In the quantum case the condition ~ h'~^ suggests that for stronger noise we can resolve the trajectory to a 
higher precision. As the noise weakens such as at decreasing temperature the stochastic features of classical trajectory 
are enhanced and measurement results on a particle's trajectory becomes l ess p recise. Further weakening the noise 
we will get to a point in which quantum or "Heisenberg" noise dominates [SOj. Here lies a fundamental difference 
between classical and quantum. In quantum mechanics the ability of resolving trajectories is not only determined by 
the precision of the measurement device but also by the temperature. As a result the error in FTs introduced by 
the resolution of trajectories increases constantly as the temperature is lowered, unlike in classical mechanics. Below 
a certain temperature, upon entering the quantum dominated regime, the imprecision in measurements will become 
too large to render any free energy calculations using FTs meaningless. 

The properties of noise acting on the quantum Brownian particle are different from the noise in the corresponding 
classical model, as was shown above. This introduces a deviation from FTs which is independent of the error 
introduced by the limited precision of measurements (discussed in the previous paragraph) . The quantum corrections 
to the noise kernel become larger at lower temperatures. As a result we expect to observe deviations from FTs at 
low temperatures. However, as we learned before, trajectories are not well-defined at arbitrarily low temperatures. 
Further quantitative analysis is necessary to establish the domain of validity of our approach and the magnitude of 
possible violations to FTs within this domain as a function of temperature. 



We mention two aspects which command our current attention on this problem. 

a. We want to be able to answer the following question: Is there a temperature range for which experiments done 
to the precision prescribed by the decoherent histories interpretation give answers different from the corresponding 
calculations based on classical mechanics with the same measurement precision imposed (theoretically measurements 
in classical systems can have infinite precision)? If so what are the form/size of these violations? Such a difference 
would be due to quantum mechanics exclusively and this is what we mean by violations of the FTs at low temperatures 
due to quantum mechanical effects. 




(74) 



C. Work in progress 
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b. Unlike in other approaches to quantum FTs, the use of open quantum system concepts and especially the 
influence functional method adopted here enable us to define and quantify heat flow in terms of the dissipative 
dynamics of the open system which results from a self-consistent treatment of the back-action from its environment. 
We want to take advantage of this approach to address questions about energy exchange between the system and the 
bath, where applications abound. 
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